Self Labels Are Good But Be Careful